Voice control information output system, voice control information output method, and recording medium

ABSTRACT

A voice control information output system includes: a voice control information obtainment unit that obtains voice control information for controlling a device based on a voice received by a voice input terminal, from a voice control system that outputs the voice control information; and an output unit that outputs display-related information for displaying a content related to the voice control information.

TECHNICAL FIELD

The present invention relates to a voice control information outputsystem, a voice control information output method, and a programthereof.

BACKGROUND ART

A service for operating a device using voice, referred to as virtualpersonal assistance (VPA), is becoming popular. Patent literature (PTL)1 discloses a voice control system for controlling the operation of adevice by receiving a natural sentence using voice.

CITATION LIST Patent Literature

PTL 1: WO2014/171144

SUMMARY OF THE INVENTION Technical Problem

In a voice control system, information related to voice control.information for controlling a device based on a voice received from auser is outputted to the user using voice. For example, in response to avoice input of “Turn on the air conditioner.” from a user, a voice soundof “Turning on the air conditioner.” is outputted from the voice controlsystem. With respect to this, there is a growing demand to visuallycheck the information related to the voice control information.

The present invention provides a voice control information output systemthat allows a user to visually check the information related to thevoice control information.

Solutions to Problem

A voice control information output system according to an aspect of thepresent invention includes a voice control information obtainment unitthat obtains voice control information for controlling a device based ona voice received by a voice obtainment unit, from a voice control systemthat outputs the voice control information; and an output unit thatoutputs display-related information for displaying a content related tothe voice control information.

A voice control information output method according to another aspect ofthe present invention includes: obtaining voice control information forcontrolling a device based on a voice received by a voice obtainmentunit, from a voice control system that outputs the voice controlinformation; and outputting display-related information for displaying acontent related to the voice control information.

A program according to another aspect of the present invention is aprogram for causing a computer to execute the above-mentioned voicecontrol information output method.

Advantageous Effect of Invention

According to the present invention, it is possible to visually check theinformation related to the voice control information.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram illustrating the functional configuration of avoice recognition system according to an embodiment.

FIG. 2 is a block diagram illustrating the functional configuration of adevice controller according to the embodiment.

FIG. 3 is a flowchart of operation example 1 of a voice controlinformation output system according to the embodiment.

FIG. 4 is a flowchart of operation example 2 of the voice controlinformation output system according to the embodiment.

FIG. 5 is a diagram for illustrating operation example 2 of the voicecontrol information output system according to the embodiment.

FIG. 6 is a diagram for illustrating an example of display-relatedinformation.

FIG. 7 is a diagram for illustrating another example of thedisplay-related information.

FIG. 8 is a diagram for illustrating another example of thedisplay-related information.

FIG. 9 is a diagram for illustrating another example of thedisplay-related information.

FIG. 10 is a diagram for illustrating another example of thedisplay-related information.

FIG. 11 is a diagram for illustrating another example of thedisplay-related information.

DESCRIPTION OF EXEMPLARY EMBODIMENTS

The following describes embodiments with reference to the drawings. Itshould be noted that the following embodiments show comprehensive orspecific illustrations. The numerical values, shapes, structuralcomponents, the arrangement and connection of the structural components,steps, the processing order of the steps, etc. shown in the followingembodiments are mere examples, and thus are not intended to limit thepresent invention. Of the structural components described in thefollowing embodiments, structural components not recited in any one ofthe independent claims that indicate the broadest concepts of thepresent invention will be described as optional structural components.

The figures are schematic illustrations and not necessarily preciseillustrations. In the figures, substantially identical components areassigned the same reference signs, and overlapping descriptions thereofmay be omitted or simplified.

Embodiment Configuration

First, the configuration of a system according to an embodiment will bedescribed. FIG. 1 is a block diagram illustrating the functionalconfiguration of voice recognition system 10 according to theembodiment.

As shown in FIG. 1, voice recognition system 10 according to theembodiment includes voice control system 20, voice control informationoutput system 30, human sensor 61, monitor 62, device 63, and router 70.Voice input terminal 21 of voice control system 20, device controller 50of voice control information output system 30, human sensor 61, monitor62, device 63, and router 70 are arranged inside premises. Voicerecognition server 22 of voice control system 20 and device controlserver 40 of voice control information output system 30 are implementedas a cloud (cloud servers). In FIG. 1, voice input terminal 80 locatedoutside the premises is also illustrated.

Configuration of Voice Control System

Voice control system 20 is a system for controlling device 63 to becontrolled using voice as an input. Voice control system 20 includesvoice input terminal 21 and voice recognition server 22.

Voice input terminal 21 is a voice input interface device that receivesa voice of a user or the like. Voice input terminal 21 is an example ofa voice obtainment unit. Voice input terminal 21 is a stationaryterminal such as a smart speaker, but a mobile terminal such as asmartphone is possible. Voice input terminal 21 may be any device aslong as it includes a sound collector such as a microphone, acommunication circuit that transmits a voice signal of the receivedvoice to voice recognition server 22, and the like. In the presentembodiment, voice input terminal 21 also has a function of outputting avoice sound. Voice input terminal 80 is typically a mobile phone. Voiceinput terminal 80 has the same functionality as voice input terminal 21,and thus its description is omitted. For example, when voice inputterminals 21 and 80 are each implemented as a mobile phone, the mobilephone serves as voice input terminal 21 when used inside premises andserves as voice input terminal 80 when used outside the premises.

Router 70 is a relay that relays data between an inside localcommunication network and a wide area communication network (e.g., theInternet) such as the outside Internet. For example, router 70 transmitsthe voice signal of the voice received by voice input terminal 21 tovoice recognition server 22 on the cloud.

Voice recognition server 22 is a server that performs a voicerecognition process on the voice signal transmitted from voice inputterminal 21. A service provider of a voice recognition service providesthe voice recognition service through voice recognition server 22. Forexample, voice recognition server 22 converts the voice signaltransmitted from voice input terminal 21 into text information, andfurther converts the text information into a command corresponding tothe text information. The command is an example of voice controlinformation for controlling device 63 based on the voice received byvoice input terminal 21. For example, when the text informationindicates a text of “Turn on the air conditioner.”, such textinformation is converted into a command for activating the airconditioner. Voice recognition server 22 further transmits the commandto device control server 40 of voice control information output system30.

Configuration of Voice Control Information Output System

Voice control information output system 30 is a system for controllingdevice 63 and the like arranged inside premises in cooperation withvoice control system 20. Voice control information output system 30includes device control server 40 and device controller 50.

Device control server 40 is a computer including a processor (amicroprocessor), a memory, a communication interface (a communicationcircuit), etc., and controls inside device controller 50 based on thecommand transmitted from voice recognition server 22. A service providerof a device control service provides the device control service usingdevice control server 40. Device control server 40 can communicate withvoice recognition server 22 and device controller 50 via a communicationinterface.

Device controller 50 is a gateway device including a processor (amicroprocessor), a memory, a communication interface (a communicationcircuit), a user interface (such as a monitor), etc. Device controller50 is connected with human sensor 61, monitor 62, device 63, and thelike which are arranged inside the premises, and has a function ofcontrolling device 63 based on the voice control information. Devicecontroller 50 also determines whether information is displayed onmonitor 62 in accordance with the result obtained by human sensor 61, asdescribed in detail below. Device controller 50 can communicate withdevice control server 40, human sensor 61, monitor 62, and device 63 viaa communication interface. It should be noted that the communicationbetween device controller 50 and human sensor 61, monitor 62, and device63 may be a wired communication or a wireless communication.

Human sensor 61 senses a state of a person in a predetermined area wherea voice is to be received by input terminal 21 (i.e., a predeterminedinside area), and outputs person information indicating the state of theperson. For example, the state of the person refers to whether or not aperson is present. Human sensor 61 may be implemented. as a singledevice or a part of another device. For example, human sensor 61 is adevice that directly senses whether a person is present inside thepremises, and is more specifically a sensor that senses infrared raysemitted from the human body. Human sensor 61 also may be a camera thatcan sense the state of the person, as well as whether or not a person ispresent.

Human sensor 61 also may be a device that indirectly senses whether aperson is present inside the premises. In this case, human sensor 61 ismore specifically a locking system of a front door. In this case, it isdetermined based on the locking state of the front door whether a personis present inside the premises. For example, when the front door isunlocked, it is determined that a person is present inside the premises.Human sensor 61 also may he an electric power measurement device formeasuring the inside power consumption. In this case, it is determinedbased on inside power consumption information whether a person ispresent inside the premises. For example, when the inside powerconsumption is at least a predetermined value, it is determined that aperson is present inside the premises.

Human sensor 61 also may be a sound collector different from voice inputterminal 21. In this case, it is determined based on the obtained voicecondition whether a person is present inside the premises. For example,when the obtained voice has a predetermined sound pressure level ormore, it is determined that a person is present inside the premises.

Human sensor 61 may be a sensor that senses an IC tag worn by a user ora built-in IC tag of a mobile terminal carried by a user. It should benoted that when human sensor 61 is a sensor capable of sensing an ICtag, it is possible to detect whether a specific person is present inthe predetermined area.

Monitor 62 is a display for displaying a content related to the voicecontrol information, and is a display included in a tablet, a smartphone, a television, etc. More specifically, based on display-relatedinformation for displaying the content related to the voice controlinformation, a tablet, a smart phone, a television, etc. displays thecontent related to the voice control information on monitor 62. Itshould be noted that monitor 62 may be a display included in devicecontroller 50.

For example, device 63 is a home appliance such as an air conditioner,but a device other than home appliances such as a locking system of afixture (e.g. a front door) is possible.

Specific Configuration of Device Controller

FIG. 2 is a block diagram illustrating the functional configuration ofdevice controller 50 according to the embodiment.

In the embodiment, device controller 50 includes voice controlinformation obtainment unit 51, output unit 52, and person informationobtainment unit 53 which are each an inventive functional component invoice control information output system 30.

Voice control information obtainment unit 51 obtains the voice controlinformation from voice control system 20 that outputs the voice controlinformation for controlling device 63 based on the voice received byvoice input terminal 21 or 80. In the present embodiment, voice controlinformation obtainment unit 51 obtains the voice control informationfrom voice control system 20 via device control server 40.

Output unit 52 outputs the display-related information for displaying acontent related to the voice control information. In the presentembodiment, output unit 52 outputs the display-related information tomonitor 62. Output unit 52 also outputs control information forcontrolling device 63 based on the voice control information.

Person information obtainment unit 53 obtains person informationindicating a state of a person in the predetermined area outputted byhuman sensor 61.

Voice control information obtainment unit 51, output unit 52, and personinformation obtainment unit 53 are implemented by causing a processor toexecute a program stored on a memory included in device controller 50.

It should be noted that voice control information obtainment unit 51,output unit 52, and person information obtainment unit 53 may beseparately arranged in device control server 40 and device controller 50of voice control. information output system 30, or all of the functionalcomponents may be included in device control server 40.

Operation Example 1 of Voice Control Information Output System

Next, operation example 1 of voice control information output system 30will be described. FIG. 3 is a flowchart of operation example 1 of voicecontrol information output system 30.

First, voice control information obtainment unit 51 obtains the voicecontrol information (step S11). Next, output unit 52 outputs thedisplay-related information for displaying a content related to thevoice control information (step S12). With this, the content related tothe voice control information is displayed on monitor 62, and thus auser can visually check the information related to the voice controlinformation (display-related information). The specific examples of thedisplay-related information will be described in FIG. 6 though FIG. 11below.

As the case where such voice recognition system 10 is used, the casewhere a user stays inside or the case where a user stays outside will betaken. In the case where a user stays inside, the user talks to voiceinput terminal 21 to control device 63, and the content related to thevoice control information is displayed on monitor 62 in response to thetalking. On the other hand, in the case where a user stays outside, evenwhen the user talks to voice input terminal 80 (such as a mobile phone)to control device 63, the content related to the voice controlinformation need not be displayed on monitor 62. Instead, when a userdifferent from the user who has talked outside stays inside and thecontent related to the voice control information has been displayed onmonitor 62, the inside user does not understand why monitor 62 has beenturned on and may misunderstand that errors has occurred.

Accordingly, voice control information output system 30 (in the presentembodiment, device controller 50) includes person information obtainmentunit 53, and output unit 52 outputs the display-related information inaccordance with the state of the person obtained by person informationobtainment unit 53.

Operation Example 2 of Voice Control Information Output System

This will be described as operation example 2 of voice controlinformation output system 30 based on the state of the person indicatedby the person information obtained by person information obtainment unit53. FIG. 4 is a flowchart of operation example 2 of voice controlinformation output system 30 according to the embodiment. Here, personinformation obtainment unit 53 obtains the person information indicatingthe state of the person in the predetermined inside area. For example,the person information is information indicating whether or not a personis present.

First, output unit 52 determines whether a person is present in thepredetermined area, more specifically, whether the person informationobtained by person information obtainment unit 53 indicates that aperson is present in the predetermined area (step S21).

When it is determined that the person information indicates that aperson is present in the predetermined area (Yes at step S21), outputunit 52 outputs the display-related information (step S22). On the otherhand, when it is determined that the person information indicates thatno person is present in the predetermined area (No at step S21), outputunit 52 does not output the display-related information (step S22).Operation example 2 will be described in detail with reference to FIG.5.

FIG. 5 is a diagram for illustrating operation example 2 of voicecontrol information output system 30 according to the embodiment.

When user 100 a is present, in the predetermined inside area (when humansensor 61 senses that a person is present in the predetermined area),voice input terminal 21 receives a voice of user 100 a and transmits thevoice signal of the received voice to voice recognition server 22. Voicerecognition server 22 performs the voice recognition process on thevoice signal transmitted from voice input terminal 21, and transmits, tovoice control information output system 30, a voice control signalconverted from the voice signal. At this time, the person informationobtained from human sensor 61 by person information obtainment unit 53indicates that a person is present in the predetermined area, and thusoutput unit 52 transmits, to monitor 62, the display-related informationfor displaying the content related to the voice control signal. Withthis, user 100 a can visually check the display-related information byviewing monitor 62.

Next, when no user is present in the predetermined inside area anddevice 63 is remotely controlled by user 100 b (e.g., a person involvedin a facility to which voice control information output system 30 isapplied), voice input terminal 80 receives a voice of user 100 b andtransmits the voice signal of the received voice to voice recognitionserver 22. Voice recognition server 22 performs the voice recognitionprocess on the voice signal transmitted from voice input terminal 21,and transmits, to voice control information output system 30, the voicecontrol signal converted from the voice signal. At this time, the personinformation obtained from human sensor 61 by person informationobtainment unit 53 indicates that no person is present in thepredetermined area, and thus output unit 52 does not transmit, tomonitor 62, the display-related information for displaying the contentrelated to the voice control signal. With this, even when another useris present in an area other than the predetermined inside area, it ispossible to prevent the monitor from being turned on.

Next, when no user is present in the predetermined inside area and forexample, outside malicious user 100 c attempts to input a voice intoinside voice input terminal 21 from outside using a loud voice, voiceinput terminal 21 may receive a voice of user 100 c and transmit thevoice signal of the received voice to voice recognition server 22. Voicerecognition server 22 performs the voice recognition process on thevoice signal transmitted from voice input terminal 21, and transmits, tovoice control information output system 30, the voice control signalconverted from the voice signal. At this time, the person informationobtained from human sensor 61 by person information obtainment unit 53indicates that no person is present in the predetermined area, and thusoutput unit 52 does not transmit, to monitor 62, the display-relatedinformation for displaying the content related to the voice controlsignal. With this, even when a user is present in an area other than thepredetermined inside area, it is possible to prevent the monitor frombeing turned on.

In this way, when no user who wants to control device 63 using voiceinput terminal 21 is present in the predetermined inside area, it ispossible not to output the display-related information to monitor 62even if device 63 is controlled from outside.

Specific Examples of Display-Related Information

Next, specific examples of the display-related information will bedescribed reference to FIGS. 6 through 11.

FIGS. 6 through 11 are each a diagram for illustrating an example of thedisplay-related information. In FIGS. 6 through 9, device 63 isimplemented as an air conditioner.

For example, the display-related information includes information aboutthe state of device 63 controlled based on the voice controlinformation. This will be described with reference to FIG. 6.

As shown in FIG. 6, voice input terminal 21 receives a voice of “Turn onthe living room air conditioner.” of user 100 a. Voice recognitionserver 22 performs the voice recognition process on the voice signaltransmitted from voice input terminal 21 to generate the voice controlsignal for controlling device 63, and voice control information outputsystem 30 controls device 63 based on the generated voice controlsignal. Here, voice control information output system 30 activatesdevice 63 (the air conditioner). Simultaneously, voice controlinformation output system 30 transmits, to voice control system 20,information indicating that device 63 is activated, and voice inputterminal 21 outputs a voice sound of “Turning on the living room airconditioner.”, for example. At this time, monitor 62 displays theinformation about the state of device 63 controlled based on the voicecontrol information. For example, when device 63 is an air conditioner,the information about the state of device 63 is information such asoperation mode, temperature setting, fan power, or wind direction of theair conditioner. With this, user 100 a can visually check the state ofdevice 63. Thus, for example, when the current state of device 63 is nota state desired by user 100 a, user 100 a can give an instruction tochange the state of device 63.

Furthermore, for example, the display-related information includeswarning information related to the control of device 63. This will bedescribed with reference to FIG. 7.

As shown in FIG. 7, voice input terminal 21 receives a voice of “Turn onthe living room air conditioner.” of user 100 a. Voice recognitionserver 22 performs the voice recognition process on the voice signaltransmitted from voice input terminal 21 to generate the voice controlsignal for controlling device 63, and voice control information outputsystem 30 controls device 63 based on the generated voice controlsignal. Here, voice control information output system 30 activatesdevice 63 (the air conditioner). At this time, device 63 (the airconditioner arranged in the living room) is associated with anopen-close sensor or the like that is attached to a living room windowand senses whether the window is open or closed, and thus monitor 62displays the warning information related to the control of device 63.For example, the warning information is information indicating that awindow in a room (i.e., the living room) equipped with device 63 the airconditioner) to be controlled is open. With this, user 100 a canvisually check the warning information related to the control of device63. Thus, for example, user 100 a can efficiently operate the airconditioner arranged in the living room by closing the living roomwindow.

Furthermore, for example, the display-related information includesinformation for controlling device 63 based on the voice controlinformation. More specifically, the information for controlling device63 includes information for identifying the details of the control ofdevice 63, or information for identifying device 63 to be controlled.This will be described with reference to FIG. 8.

As shown in FIG. 8, voice input terminal 21 receives a voice of “Turn onthe air conditioner.” of user 100 a. Voice recognition server 22performs the voice recognition process on the voice signal transmittedfrom voice input terminal 21 to generate the voice control signal forcontrolling device 63, and voice control information output system 30controls device 63 based on the generated voice control signal. At thistime, when there are three air conditioners controllable by voicecontrol information output system 30, voice control information outputsystem 30 cannot determine only from a voice of “Turn on the airconditioner.” of user 100 a which air conditioner should be turned on.Accordingly, voice control information output system 30 transmits, tovoice control system 20, information indicating that it is unclear whichair conditioner should be turned on, and voice input terminal 21 outputsa voice sound of “Which room air conditioner should be turned on?”, forexample. At this time, monitor 62 displays the information foridentifying device 63 to be controlled. For example, this information isinformation indicating that the living room, the bed room, and the kid'sroom are possible as an area equipped with the controllable airconditioner (the registered air conditioner). With this, user 100 a canvisually check which room air conditioner can be turned on, and thus canactivate the desired room air conditioner.

It should be noted that although not shown in the figure, for example,monitor 62 may display the details of possible control to be performedby device 63 (such as operation in cooling/heating mode, or change intemperature, air volume, or wind direction) as information foridentifying the details of the control of device 63 With this, user 100a can visually check how the air conditioner can be controlled, and thuscan operate the air conditioner based on the details of the desiredcontrol.

Furthermore, for example, when device 63 cannot be controlled based onthe voice control information, display-related information includes atleast one of information about the failure to control device 63 andinformation for placing device 63 into the state of being controlledbased on the voice control information. This will be described withreference to FIG. 9.

As shown in FIG. 9, voice input terminal 21 receives a voice of “Turn onthe living room air conditioner.” of user 100 a. Voice recognitionserver 22 performs the voice recognition process on the voice signaltransmitted from voice input terminal 21 to generate the voice controlsignal for controlling device 63, and voice control information outputsystem 30 controls device 63 based on the generated voice controlsignal. However, when device 63 is broken or the connection betweendevice controller 50 and device 63 has a problem, voice controlinformation output system 30 may not control device 63. In this case,voice control information output system 30 transmits, to voice controlsystem 20, information indicating the failure to control the airconditioner, and voice input terminal 21 outputs a voice sound of “Thecontrol failed.”, for example. At this time, when voice controlinformation output system 30 knows that the failure to control is causedby the network connection problem, monitor 62 displays information forplacing device 63 into the state of being controlled based on the voicecontrol information (here, the state in which the air conditioner isactivated). For example, this information is information for urging auser to solve the network connection problem. With this, user 100 a canvisually check how the air conditioner is placed into the state of beingactivated, and thus can activate the air conditioner by solving thenetwork connection problem.

It should be noted that although not shown in the figure, monitor 62 maydisplay the information about the failure to control device 63 (such as“The control failed.”). With this, user 100 a can visually check thefailure to activate the air conditioner.

Furthermore, for example, the voice control information includes answerinformation to a voice received by voice input terminal 21, and thedisplay-related information includes information related to the answerinformation. This will be described with reference to FIG. 10.

As shown in FIG. 10, voice input terminal 21 receives a voice of “Howmuch is this month's electric bill?” of user 100 a. Voice recognitionserver 22 performs the voice recognition process on the voice signaltransmitted from voice input terminal 21 to generate the voice controlsignal for controlling device 63. Here, device 63 is a device or thelike capable of managing the electric bill of user 100 a, and the voicecontrol signal for controlling device 63 serves as the answerinformation for generating an answer to the voice received by voiceinput terminal 21. Voice control information output system 30 transmitsthe generated answer to voice control system 20, and voice inputterminal 21 outputs a voice sound of “It is 3,240 yen.”, for example. Asthe information related to the answer information, monitor 62 displaysthis month's electric bill which is the answer. With this, user 100 acan visually check the answer (i.e., this month's electric bill).

Furthermore, the information related to the answer information mayinclude more detailed information than the answer information. Morespecifically, monitor 62 may display not only this month's electric billas shown in FIG. 10, but also a graph or information about last month'selectric bill, etc. as well as this month's electric bill as thedetailed information as shown in FIG. 11.

Advantageous Effects, etc.

As described above, voice control information output system 30 includes:voice control information obtainment unit 51 that obtains voice controlinformation for controlling device 63 based on a voice received by avoice obtainment unit (voice input terminal 21 or 80), from voicecontrol system 20 that outputs the voice control information; and outputunit 52 that outputs display-related information for displaying acontent related to the voice control information.

With this, the display-related information for displaying the contentrelated to the voice control information is provided to monitor 62 orthe like and thus user 100 a can visually check the information relatedto voice control information.

Furthermore, for example, the display-related information includesinformation about a state of device 63 controlled based on the voicecontrol information.

With this, user 100 a can visually check the state of device 63. Forexample, user 100 a can easily recognize a difference between thecurrent state and the desired state of device 63.

Furthermore, for example, the display-related information includesinformation for controlling device 63 based on the voice controlinformation. More specifically, the information for controlling device63 includes information for identifying details of the control of device63 or information for identifying device 63 to be controlled.

With this, user 100 a can visually check the information for identifyingthe details of the control of device 63, or information for identifyingdevice 63 to be controlled. For example, user 100 a can easily give aninstruction on the details of the desired control or a device to becontrolled.

Furthermore, for example, the voice control information includes answerinformation to the voice received by the voice obtainment unit (voiceinput terminal 21 or 80), and the display-related information includesinformation related to the answer information.

With this, user 100 a can visually check the information related to theanswer information.

Furthermore, for example, the information related to the answerinformation includes more detailed information than the answerinformation.

With this, user 100 a can visually check the more detailed informationthan the answer information.

Furthermore, for example, when device 63 fails to be controlled based onthe voice control information, the display-related information includesat least one of information about the failure to control device 63 andinformation for placing device 63 into a state of being controlled basedon the voice control information.

With this, user 100 a can visually check the information about thefailure to control device 63 or the information for placing device 63into the state of being controlled based on the voice controlinformation. For example, user 100 a can easily recognize a problemoccurred in device 63 or the like or how to address the problem.

Furthermore, for example, the display-related information includeswarning information related to the control of device 63.

With this, user 100 a can visually check the warning information relatedto the control of device 63.

Furthermore, for example, the voice control information output system 30further includes person information obtainment unit 53 that obtainsperson information indicating a state of a person in a predeterminedarea, in which output unit 52 outputs the display-related informationbased on the state of the person indicated by the person informationobtained by person information obtainment unit 53. More specifically,the person information is information indicating whether or not a personis present, and output unit 52 outputs the display-related informationwhen the person information indicates that a person is present in thepredetermined area, and does not output the display-related informationwhen the person information indicates that no person is present in thepredetermined area.

With this, when no user who wants to control device 63 using voice inputterminal 21 is present in the predetermined inside area, it is possiblenot to output the display-related information to monitor 62 even ifdevice 63 is controlled from outside.

Other Embodiments

Although a preferred embodiment has been described above, the presentinvention is not limited to the foregoing embodiment.

For example, in the foregoing embodiment, the state of the person refersto whether or not a person is present. Although output unit 52 outputsthe display-related information when a person is present and does notoutput the display-related information when no person is present, thepresent invention is not limited to this. For example, when monitor 62is a TV display and person information obtainment unit 53 obtainsinformation indicating that the state of the person in the predeterminedarea is a state of watching TV, output unit 52 need not output thedisplay-related information. With this, when a person is watching TV, itis possible to prevent the content related to the voice controlinformation from being displayed on the TV display.

Furthermore, for example, in the foregoing embodiment, although voicecontrol information output system 30 includes person informationobtainment unit 53, that is not necessary. In other words, voice controlinformation output system 30 need not have a function of outputting thedisplay-related information based on the state of the person in thepredetermined inside area.

Furthermore, the present invention can be implemented as not only voicecontrol information output system 30 but also a voice controlinformation output method including steps (processes) performed by therespective components included in voice control formation output system30.

More specifically, as shown in FIG. 3, the voice control informationoutput method includes: obtaining voice control information forcontrolling device 63 based on a voice received by a voice obtainmentunit (voice input terminal 21 or 80), from voice control system 20 thatoutputs the voice control information (step S11); and outputtingdisplay-related information for displaying a content related to thevoice control information (step S12).

For example, these steps may be executed by a computer (a computersystem). Moreover, the present invention can be implemented as a programfor causing a computer (clean-up assistance program) to execute thesteps included in the method. Furthermore, the present invention can beimplemented as a non-transitory computer-readable recording medium suchas a CD-ROM or the like having the program recorded thereon.

For example, when the present invention is implemented as a program (asoftware), each of the steps is performed by executing the program usinga hardware resource such as a CPU, a memory, an input-output circuit,etc. in a computer. In other words, the CPU obtains data from thememory, the input-output circuit, or the like to perform operations, oroutputs the operation results to the memory, the input-output circuit,or the like, and thereby each step is performed.

Moreover, each of the components included in voice control informationoutput system 30 according to the foregoing embodiment may beimplemented as a dedicated or a general-purpose circuit.

Moreover, each of the components included in voice control informationoutput system 30 according to the foregoing embodiment may beimplemented. as a large scale integration (LSI) which is an integratedcircuit (IC).

Moreover, the IC is not limited to the LSI, and may be implemented by adedicated circuit or a general-purpose processor. A field programmablegate array (FPGA) which is programmable or a reconfigurable processor inwhich the connection and configuration of circuit cells in a LSI arereconfigurable may be applicable.

Furthermore, in the event that an advance in or derivation fromsemiconductor technology brings about an integrated circuitry technologywhereby an LSI is replaced, each of the components included in voicecontrol information output system 30 may be obviously integrated usingsuch new technology.

Embodiments arrived at by a person skilled in the art making variousmodifications to the embodiment as well as embodiments realized byarbitrarily combining structural components and functions in theembodiment which do not depart from the essence of the present inventionare included in the present invention.

REFERENCE MARKS IN THE DRAWINGS

-   20 voice control system-   21, 80 voice input terminal (voice obtainment unit)-   30 voice control information output system-   51 voice control information obtainment unit-   52 output unit-   53 person information obtainment unit-   63 device

1. A voice control information output system, comprising: a voice control information obtainment unit that obtains voice control information for controlling a device based on a voice received by a voice obtainment unit, from a voice control system that outputs the voice control information; and an output unit that outputs display-related information for displaying a content related to the voice control information.
 2. The voice control information output system according to claim 1, wherein the display-related information includes information about a state of the device controlled based on the voice control information.
 3. The voice control information output system according to claim 1, wherein the display-related information includes information for controlling the device based on the voice control information.
 4. The voice control information output system according to claim 3, wherein the information for controlling the device includes information for identifying details of the control of the device or information for identifying the device to be controlled.
 5. The voice control information output system according to claim 1, wherein the voice control information includes answer information to the voice received by the voice obtainment unit, and the display-related information includes information related to the answer information.
 6. The voice control information output system according to claim 5, wherein the information related to the answer information includes more detailed information than the answer information.
 7. The voice control information output system according to claim 1, wherein when the device fails to be controlled based on the voice control information, the display-related information includes at least one of information about the failure to control the device and information for placing the device into a state of being controlled based on the voice control information.
 8. The voice control information output system according to claim 1, wherein the display-related information includes warning information related to the control of the device.
 9. The voice control information output system according to claim 1, further comprising: a person information obtainment unit that obtains person information indicating a state of a person in a predetermined area, wherein the output unit outputs the display-related information based on the state of the person indicated by the person information obtained by the person information obtainment unit.
 10. The voice control information output system according to claim 9, wherein the person information is information indicating whether or not a person is present, and the output unit outputs the display-related information when the person information indicates that a person is present in the predetermined area, and does not output the display-related information when the person information indicates that no person is present in the predetermined area.
 11. A voice control information output method, comprising: obtaining voice control information for controlling a device based on a voice received by a voice obtainment unit, from a voice control system that outputs the voice control information; and outputting display-related information for displaying a content related to the voice control information.
 12. A non-transitory computer-readable recording medium for use in a computer, the recording medium having a computer program recorded thereon for causing the computer to execute the voice control information output method according to claim
 11. 